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We study numerically the nonequilibrium dynamics of the three-dimensional Heisenberg Edwards- 
Anderson spin glass submitted to protocols during which temperature is shifted or cycled within the 
spin glass phase. We show that (partial) rejuvenation and (perfect) memory effects can be numeri- 
cally observed and study both effects in detail. We quantitatively characterize their dependences on 
parameters such as the amplitude of the temperature changes, the timescale at which the changes 
are performed, and the cooling rates used to vary the temperature. We contrast our results both to 
those found numerically in the fsing version of the model, and to experimental results in different 
samples. We discuss the theoretical interpretations of our findings, arguing, in particular, that 'full' 
rejuvenation can be observed in experiments even if temperature chaos is absent. 
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I. INTRODUCTION TO BASIC PHENOMENA 

In recent worki we studied the nonequilibrium dynam- 
ics of the Heisenberg Edwards- Anderson spin glass model 
in three dimensions following a sudden quench to its low 
temperature phase. Here we continue our investigations 
of the nonequilibrium, low temperature dynamics of this 
model by analyzing its behavior in more complex proto- 
cols, similar to those performed in experiments^* 3 ^. More 
precisely, we consider in detail the effects of a tempera- 
ture cycle (illustrated in Fig.^) consisting of the following 
three steps: 

1. Quench the system from T = oo to a temperature 
T\ at time t w = 0, and wait a time t\. 

2. Then change the temperature to a lower value Ti 
and wait a further time ti- 



3. At total time t v 
back to T\ . 



t2 change the temperature 



This temperature cycling protocol has been used 
extensively to characterize several spin glass sys- 
terna 2 . 3 . 4 . 5 . 6 . 7 . 8 . 9 ! 10 . 11 ! 12 ! 13 : 14 ! 15 , and these studies moti- 
vated similar cycling experiments on many different types 
of glassy materiala 16 ! 17 ! 18 ! 19 ! 20 ! 21 ! 22 ! 23 : 24 ! 25 . 

Numerical studies of temperature shifts and cy- 
cles in the Ising version of the model have been re- 
ported 26 i 27 i 2s i 29 i 30 i 31 i 32 i 33 , and temperature cycles have 
been discussed theoretically 34 i 35 i 36 . 37 i 38 i 39 i 40 i 41 i 42 . How- 
ever, the Heisenberg spin glass model has been much 
less studied than its Ising counterpart, even though it 
is closer to many of the experimentally studied spin glass 
systems, and only a few aging studies exist 1 ! 32 ^ 3 ! 44 . In 
particular, extensive studies of temperature cycles have 
not been reported (see Ref. |32] for preliminary results) 
and we attempt here to fill this gap. 



The Heisenberg spin glass model that we study has the 
Hamiltonian 



H 



(id) 



(1) 



where the sum is over nearest neighbors of a cubic lattice 
of linear size L = 60 with periodic boundary conditions, 
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FIG. 1: Time evolution of x(uo,t v ) in a temperature cycle 
performed with the three-dimensional Heisenberg spin glass 
for 1/lu = f078. Aging is observed in the first ti = fff59 
sweeps during which the temperature is at Ti = 0.f4 < T c ~ 
0.16. The temperature is then quenched to T2 = 0.04 for the 
next t2 = 11159 sweeps. This causes aging to restart, a re- 
juvenation effect. The long-dashed line shows the result of a 
direct quench from T = 00 to Tb at time ti. The variation 
of x(^,iw) with t w is much stronger than when the temper- 
ature is shifted from Ti to T2, showing that rejuvenation in 
the temperature shift is only partial. At t w = t% + ti the 
temperature is shifted back to its initial value, and the data 
seems to be simply a continuation of that for t w < ti. This 
memory effect is illustrated more clearly in the inset where 
the intermediate time spent at T2 = 0.04 has been removed. 
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the Si are three-component vectors of unit length and 
coupling constants are drawn from a symmetric Gaus- 
sian distribution of standard deviation unity. We refer to 
our previous papesi for the technical details concerning 
our simulations. When performing temperature cycles 
a large number of parameters can be varied, implying 
a larger numerical effort than was needed in the simple 
aging studies of Ref . . 

The basic quantity we measure is the two-time auto- 
correlation function of the spins, C(t w ,t w + r), defined 
by 

C(t w ,t w +r) = — ^(Si(t w ) • Si(tw + r)), (2) 

i 

where the brackets indicate an average over both thermal 
histories and disorder. To compare with experiment we 
often plot instead 

X (uJ,t w ) = , (3) 

since this is expected to have similar behavior to the ac 
magnetic susceptibility at frequency u>. 

A representative sample of our results for a tempera- 
ture cycle is shown in Fig. ^ For f w < t\ this is just 
a 'simple aging' experiment corresponding to quenching 
the system infinitely fast from an infinite to a low tem- 
perature, T\ = 0.14 < T c ~ 0.16. Physical quantities 
then slowly relax towards equilibrium, which is known as 
aging. We have characterized this behavior in detail in 
Ref. Q. 

For t\ < t w < t\ + t2, during which the temperature 
is T-i = 0.04 < T±, the signal just after the shift is not a 
simple continuation of the decay at the previous temper- 
ature. The system has apparently forgotten it is already 
'old' and it seems therefore 'rejuvenated' by the temper- 
ature change. In experiments performed on Heisenberg 
spin glasses, when T\ — T% is sufficiently large, the sig- 
nal obtained after the shift can be exactly superposed 
on the one obtained after a direct quench from T — oo 
to T = T2, implying that the system behaves as if it had 
fully forgotten the time spent at temperature T± . We will 
call this situation 'full rejuvenation'. However, rejuvena- 
tion is not full in our simulations because the change in 
X(w, t w ) with time during the part of the temperature cy- 
cle at T2 is less than the change found in a direct quench 
to T2 , which is shown by the long-dashed line in Fig. ^ 
Since we do not observe full rejuvenation we will need to 
ask whether the observed behavior is rejuvenation at all 
or whether it can be fully explained in terms of the cumu- 
lative aging scenario, discussed below in Sec. [n] We will 
also investigate the possible origins of this significant dif- 
ference between numerical and experimental results, and 
will discuss in particular the role of finite cooling rates in 
experiments in Sees. 1111 Ul and IVd 

Finally, in the third part of the experiment, i w > 
t\ + t%, the relaxation proceeds, after a short transient, 
as if the second step had not occurred. The system has 



kept a 'memory' of the first aging step despite the strong 
restart observed in the second part of the protocol. In 
the inset of Fig. 2J we show that the third part of the 
experiment appears to be the simple continuation of the 
first part, as if the second step had not taken place, which 
we call a 'perfect memory effect'. This figure is not en- 
tirely convincing, though, because the signal is nearly 
flat and small deviations from perfect memory could be 
invisible on that scale. That memory is indeed close to 
perfect, at least for large temperature shifts, will be more 
quantitatively demonstrated in Sec. IIVI 

In the rest of this work, we analyze in more detail the 
rejuvenation and memory effects seen in Fig. ^ Section 
12] gives some theoretical background on the cumulative 
aging scenario, according to which the effects seen are 
simply due to changes in the rate of growth of correla- 
tions with temperature. Our data on rejuvenation and 
memory are described in Sees. IIIII and IIVI respectively. 
We discuss our results in Sec. |Vj and give a final sum- 
mary in Sec. IV1I 



II. CUMULATIVE AGING 

An important theoretical concept in understanding 
non-equilibrium data for spin glasses is that of a dynami- 
cal correlation length, £(T, t), which describes the spatial 
extent of spin correlations after aging a time t at temper- 
ature T . In the cumulative aging scenario, it is proposed 
that the observed phenomena can be understood solely in 
terms of the time and temperature dependences of £(T, t). 
We now discuss the predictions of cumulative aging, first 
for the step down in temperature from T\ to T% which 
can lead to rejuvenation, and then for the subsequent 
step back up to T\ which can lead to memory. 



A. Cumulative aging and rejuvenation 

If the correlation length grows to a value £(Ti,ii) by 
waiting a time t\ at T\, then one would have to wait a 
longer time, t^ m , at the lower temperature T2 to get the 
same correlation length, where this 'effective age' in the 
cumulative aging scenario is given by 

an,^ = aT 2 ,ttr)- (4) 

If the growth law £ (T, t) is known accurately, Eq. Q can 
be used to determine i^g m for given values of T\ , T2 and 
tv 

In practice one can try to fit the data for x(w,ti + t) 
during the time spent at T2 to data for (o>, f c ff + t), 
i.e. data in a single quench to T2 for some waiting time 
t c ff + 1 with t e s used as a free fitting parameter. In other 
words t c fi is determined from matching both sides of the 
following equation, 

X{uj, ti+t) = Xt 2 ( w > tcs + t) . (5) 
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One of the following scenarios might then occur. A 
first possibility is that 



t, 



off 



0, 



(6) 



which corresponds to full rejuvenation. The time spent 
at T\ is irrelevant for aging at T 2 . This is seen experi- 
mentally for large temperature shifts, but not in any of 
our simulations. 

Second, one might find that 



to 



t: 



(J) 



where t^g m is given by Eq. This is the so-called 

cumulative aging scenario. We shall see in Sec. II VBl that 
this case describes our simulations when the temperature 
difference T\ — T 2 is small, though we show in Sec. IIII Al 
that it does not work when T\ — T 2 is large. However, 
Eq. does not correspond to rejuvenation. Rather, 
rejuvenation is defined to be the additional effect beyond 
Eq. J7J, since the latter simply reflects the change in the 
rate of growth of the correlation length with temperature. 
A third possibility is that 



< i cff < t3f 



(8) 



This is one way in which partial rejuvenation could oc- 
cur, and is seen in some experiments&ii^ at intermediate 
values of the temperature shift. However our simulations 
do not fit this scenario. Rather, for large values of T\ — T 2 
we will see in Sec. 1111 Al that our data cannot be collapsed 
on to data for a direct quench by shifting the time. Hence 
the effective age £ e ff cannot be defined in our simulations 
at large temperature differences, and so our results in 
this region do not fit any of the above scenarios. 

Remark that if t\ and T% — T 2 are sufficiently large, 
i™ m will be much larger than t\. One can make this 
statement more quantitative by assuming, as usual, that 
equilibration proceeds by activation over barriers, where 
the barrier height AE is some function of the length scale 
£. Writing t — toexp(AE(£)/T), where to is a micro- 
scopic attempt time which we set to 1, Eq. J3J gives 



T\ lnii = T 2 lni 
which can be written as 



cum 
eff ) 



hi 



'eff 

u 



Ti-T 2 
To 



In fi 



(9) 



(10) 



Hence if (T a - T 2 )mii > T 2 we have > t x . As 
a result, xi^^i + t), given by Eq. J5J), will vary very 
little with t unless t greatly exceeds t\, which is not the 
case in the simulations. Although the reasoning leading 
to Eqs. © and l|l(J|) is for a particular simple model of 
the growth of the correlation length, we expect the result 
ig™ ^ t\ to be more generally correct. 



B. Cumulative aging and memory 

In a similar way we can fit the data for t\ + 1% + 1) 
after the step back up to T± to data for \ Tl ( w j tx+t e s+t), 



X (h +t 2 +t)= Xt , («, h + ten + t) 



(11) 



assuming that the two functions of t in this expression 
can be matched for a particular choice of t c ff . If memory 
is perfect then 



t e « = , 



(12) 



so that the time spent at T 2 simply plays no role in the 
subsequent aging at T\. 

In the cumulative aging scenario t e s — f^ m where 



t(T 1 ,t 1 +ttr) = ti(T2,t'+t 2 ) 



(13) 



in which t' is the time the system would have to age at T 2 
to get the correlation length it reached at T\ after time 
t\. It is given implicitly by 



£(T 2 ,i')=£(Ti,ti), 



(14) 



as in Eq. Q above. This is shown graphically for a set 
of experimental parameters in Fig. 1121 below. 

It is worth mentioning that at extremely long times or 
for very large changes in temperature one expects perfect 
memory even in the cumulative aging scenario. This is 
because, at long times, growth of £ with time at the lower 
temperature T 2 is much slower than at T\, so t' is huge, 
the difference £,{T 2l t' + t 2 ) — £(T 2 ,t') is small, and hence 
tgj| m is small. As in Sec. Ill Al we can make this more 
quantitative within a barrier activation model for which 
Eqs. (O and imply 



T 2 \n{t'+t 2 ) = Tiln(ti+t^ n ) ; 
T 2 \nt' = Tilnti. 

We expect perfect memory if 

t' S> t 2 (perfect memory). 

Since t\ ~ t 2 , from Eq. (|16|l this gives 



(15) 
(16) 



(17) 



T x -T 2 
T 2 



> 



1 



lnti 



(perfect memory). (18) 



Eq. I|17|l is equivalent to the condition tlg m <C t 2 since 
eliminating of t' from Eqs. I|15l) and (|16|l . gives 



''eff 

ta 



exp 



T 2 



lnii 



(19) 



assuming tjj™ <C t\. Hence, if Eq. I |18| l is satisfied, one 
has perfect memory in the cumulative aging scenario. 
This conclusion should again be more general than the 
particular barrier activation model we used. 
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FIG. 2: The behavior of x(w,ti + t) during the time t spent 
at temperature T2 = 0.04 for different values of the time, 
ti, waited at Ti = 0.14. We fix 1/w = 1078. For ti = 0, 
the system undergoes a direct quench to T = T2, while for 
ii — v 00, the system has time to equilibrate at Ti. The restart 
of aging (rejuvenation) is reduced when t\ increases from 0, 
but remains non-zero even when t% 00. 



III. REJUVENATION 

Now we discuss in detail our results for the behavior 
following the temperature drop to T 2 and their interpre- 
tation. 



A. Do we really observe rejuvenation? 

It is clear from Fig. ^ that aging is strongly restarted 
when temperature changes from T\ = 0.14 to T 2 = 0.04, 
but that, unlike in experiments, the effect is weaker than 
when the system is directly quenched to T 2 . In Fig. [3 we 
show the systematic trend in the data when we vary the 
time t\ spent at the upper temperature T\. Two impor- 
tant pieces of information can be deduced from Fig. [21 

• The case of t\ — corresponds to a direct quench 
from T = 00 to T = T 2 . We see from Fig. that 
the signal obtained after waiting for a finite value of 
t\ at T — T\ is different from the signal obtained in 
a direct quench and differs more as t\ is increased. 
In 'full rejuvenation', as seen in experiments, the 
data after waiting a time t\ is the same as in a 
direct quench. We were not able to vary parame- 
ters of temperature cycles in such a way that full 
rejuvenation is observed in our simulations. 

• When t\ increases, the signal saturates to a limit- 
ing behavior. This is actually the region in which 
the intermediate part of Fig. ^ wa s obtained, since 
ii is quite large there. This saturation implies 
that even if we were able to equilibrate the sys- 
tem at temperature T±, it would undergo aging 
when further quenched to T 2 . This is very dif- 
ferent from the behavior of a pure ferromagnet, 




10° 10 1 10 2 10 3 10 4 10 5 



T 

FIG. 3: The full lines show data for the two-time spin auto- 
correlation function C(ti + 1, t\ + t + r) as a function of the 
time difference r. The time spent at Ti = 0.14 is ti = 10 5 
and the different curves are for different values of t, the time 
waited at T2 = 0.04, increasing from t — 2 (the lowest) to 
t — 57797 in a logarithmic progression. This data shows that 
aging is restarted in a temperature shift. The dashed lines are 
the autocorrelation function measured in a direct quench to 
T 2 = 0.04 and waiting times t = 416, 3728 and 19307 (from 
left to right). A comparison shows that the shape of the data 
found in reducing the temperature from T\ to T2 is different 
from that in the direct quench to T2. 



for instance, which would reequilibrate on a micro- 
scopic timescale upon a similar temperature change 
within its ferromagnetic phase. 

We have therefore seen that rejuvenation is not full. 
We will now argue that it is not null cither and that 
there is an additional signal beyond that expected in the 
cumulative aging scenario discussed in Sec.^ To do so 
it is useful to look at the dependence of x(w, f 1 +t) on fre- 
quency, or equivalently the dependence of the two-time 
autocorrelation function on the time difference r. The 
solid lines in Fig. [3] show data for this quantity. The sys- 
tem has spent a large time t\ — 10 5 at T = T\ = 0.14, 
sufficiently large that the data in Fig. [3] has become in- 
dependent of t\. The different curves are for different 
values of t, the time waited at Ti = 0.04, increasing from 
t = 2 to 57797 in a logarithmic progression. The curves 
do not superpose and the behavior observed in Fig. |21 is 
qualitatively similar to that obtained in simple aging ex- 
periments where samples undergo a rapid quench to the 
spin glass phase. There is a first, fast stationary decay of 
the autocorrelation functions followed by a second, much 
slower, age-dependent decay. However, there is a quan- 
titative difference since the precise shape of the data is 
actually not the same as in a direct quench to T 2 . The 
difference can be appreciated in Fig- El by comparing the 
solid with the dashed lines, which are for a direct quench 
with various waiting times. In the direct quench, the cor- 
relation function decays faster at long time differences. 

For the temperature shift to T 2 in Fig. ^ we have seen 
in Fig. that the shape of the extra signal due to this 



5 



10° 



- i — | 1 1 1 — | 1 1 r 

To = 0.14 --B- 
0.12 
0.08 

0.04 — e- 
0.02 - 




10 1 



10 2 



10 3 



t 







1 1 




1 1 1 






i i 1 1 i 

Ti = 0.16 


















0.14 




_ B 














0.12 


-■©■-_ 




H, 












0.10 
0.08 


_ _ ^ __ 






H, 










0.06 


- - O- - 


© 


®, 












0.04 


- 




















s 






■© 






























A ~ -A. 


•A., 


•& 


-© 
















A 

-A, 


"© 


o 


















•A 








o-s- 
1 


-©-- 
1 


i 1 


"4-*-- 

1 


, . 1 




, . i 


1 1 1—1 1 


i i_ 



10 4 



10° 



FIG. 4: Top: Changing the second temperature. The pro- 
tocol is T = oo — > Ti = 0.14 at time 0. Temperature is 
kept constant for ti = 11159 sweeps after which it is shifted 
to various T2 < 0.14. Bottom: Changing the first temper- 
ature. The protocol and notations are as above but with a 
fixed T 2 = 0.04 and different Ti > T 2 In both figures the ad- 
ditional amplitude of the aging signal increases with Ti — Ti. 
While cumulative aging works for small values of Ti — T2 , see 
Sec. II VI there is a genuine additional rejuvenation signal at 
large temperature differences. 



If one follows a common experimental procedure and 
defines t c g as the location of a peak in the logarith- 
mic derivative of the two-time autocorrelation function, 
S(t,t + r) = dC(t, t + r) /dlogr, one obtains a very small 
effective age from the data of Fig. [3] and then conclude 
that rejuvenation is almost full. We know, however, for 
example by comparing the shapes of the solid and dashed 
curves in Fig. [3 that this is not the case. Hence S(t, t+r) 
can not be used to quantify rejuvenation in numerical 
simulations of temperature shifts. This remark was al- 
ready made for the Ising spin glass in Ref. [3(J , although 
in a less detailed way. 

Data for a range of temperature shifts is presented in 
Fig.0] We see that the amplitude of the restart of aging is 
strongly dependent on the amplitude of the temperature 
shift. The case where T2 = T\ has no restart of aging 
and corresponds to a simple quench to T% (with the plot 
starting at waiting time t\). For T% < Ti there is an 
additional decay of x(w,i) due to the temperature shift. 
We shall see in Sec. UVBl that this effect is describable by 
cumulative aging for small temperature shifts, unlike the 
situation for large temperature shifts discussed earlier in 
this section. 

As a final comment, we note that the restart of ag- 
ing observed in the second part of the cycle shown in 
Fig- D is not an artifact produced by our choice of x(iv, t ) 
as a physical observable, as suggested in Refs. |32l33| . 
It is certainly true that the susceptibility, defined by 
Eq. © and the correlation function are not related by a 
fluctuation-dissipation relation since the system is not in 
equilibrium, and so rejuvenation effects might appear to 
be stronger using one or the other observable. However, 
Fig. |21 leaves us with no doubt concerning the fact that 
aging is restarted in a shift. 



B. Is temperature chaos relevant? 



shift is different from the result of a direct quench to T2. 
We also need to ask whether the magnitude of the extra 
signal is greater than that expected in the cumulative 
aging scenario discussed in Sec. [HI 

In Fig. 01 the time t\ — 11159 is large, since the data 
in Fig. [21 has saturated for this value of £1, and the tem- 
perature shift Ti — T 2 is large. Hence, as discussed in 
Sec. Ill Al the effective age in the cumulative aging sce- 
nario is enormous, and the time dependence of x should 
be tiny in this scenario. This is clearly not the case for 
the data in Fig. ^ We conclude that for large tempera- 
ture shifts there is genuine rejuvenation; the cumulative 
aging scenario does not work. In addition, the fact that 
the data of Fig. [3] is independent of ti, at large t\, for all 
r = lu^ 1 , implies that the above conclusion on the exis- 
tence of rejuvenation holds for any frequency u> accessible 
in our simulations. 

We note that the use of a different 'clock' to deter- 
mine effective ages could lead to the wrong impression 
that we observe full (or close to full) rejuvenation£i2M^. 



In this subsection we discuss our results about reju- 
venation effects from a theoretical point of view. As al- 
ready mentioned, the growth of correlations with time is 
characterized by a dynamical correlation length £(T, t). 
Lengthscales that are active at T\ in a given time window 
t, £1 = £(Ti,£), are typically larger than the ones active 
at Ti < Ti in the same time window, £2 = £(T2,t) < £1. 
Although £(T, t) is only a gradual function of T at fixed 
time t, £ grows very slowly (presumably logarithmically) 
with t and so it can take an astronomical amount of time 
to relax excitations of size £1 at the lower temperature 
T 2 . Roughly speaking, changing the temperature gives 
only a modest change in length scales but a huge change 
in time scales. For practical purposes, excitations of size 
£1 are frozen at Ti and dynamics at Ti is due to fluc- 
tuations at the smaller length scale £2, which had easily 
reached quasi-equilibrium at temperature Ti. Rejuvena- 
tion therefore means that equilibrium states at T\ and Ti 
are significantly 'different' on length scales of the order 
of £2- What 'different' really means will be the subject 
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of this subsection. 

Theoretically two explicit examples of this difference 
have been discussed in the literature: 

1. Temperature chaos in the scaling picture of spin 
glassea 34 ! 47 ! 48 ! 49 . 50 . 

2. Temperature dependence of the exponent of the 
power-law decay of spatial correlations in the two- 
dimensional non-disordered XY model22. 

In the temperature chaos scenario, spin orientations 
are spatially uncorrelated beyond an overlap length, 
- T 2 ), which diverges when Ti ~ T 2 -> but is 
small at large temperature differences, l Q ~ |T\ — T^ -1 ^, 
where £ is an exponent quantifying chaos. Chaos can 
therefore naturally explain full rejuvenation if £ a < & 
because equilibrium states at the two temperatures are 
uncorrelated at the important length scale of £2- As a 
consequence, aging at T\ is unable to bring the system 
closer to equilibrium at T 2 . In the opposite situation, 
4> > £2, called 'weak chaos', a smaller but non-zero reju- 
venation signal should be observed^, since there are some 
rare regions of space, occurring with probability (£2/^0)^ 
which are affected by the temperature change. 

In the two-dimensional non-disordered XY model be- 
low its Kosterlitz-Thouless transition temperature Tktj 
equilibrium spin correlations decay with a power of the 
distance r, C(r) ~ r~''( T ) where the exponent T)(T) de- 
pends continuously on T. This is because there is a line 
of critical points for < T < Tkt- Hence, when temper- 
ature is changed from T\ to T 2 all length scales have to 
readjust to the new critical point™, whatever the time 
spent at T±. Interestingly this produces a rejuvenation 
signal which is not full but becomes gradually larger when 
T\ — T 2 is increased^. 

We now investigate which of these two scenarios cor- 
responds most closely to our simulations. In Ref. |l| we 
showed that spatial spin glass correlations at short dis- 
tances, r < £(T,t), are well-described by algebraic de- 
cays with a temperature dependent exponent, C&(r,t) ~ 
r ~ a ( T ) (where C4 is defined in Eq. (|20|l below), just as 
in the two-dimensional XY model. Moreover, the reju- 
venation effect we observe in the present study has the 
same characteristics as the one found in the XY model, 
since it is never full but becomes gradually larger when 
T\ — T 2 is increased. As for the Ising spin glass models 
this shows that the rejuvenation signal observed in sim- 
ulations is largely due the temperature dependence of 
spatial correlations via the exponent ot(T). 

It remains to ask, though, whether there are addi- 
tional rejuvenation effects observed in our simulations 
due to temperature chaos. In Refs. [29 30] , it was argued 
that the answer for three and four dimensional Ising spin 
glasses is 'no'. The reason is that chaotic effects with 
temperature are very hard to detect presumably because 
the overlap length is never small in Ising systems 4 ^^. 
However, equilibrium calculations for vector spins sug- 
gest that overlap lengths should be smaller in the Heisen- 
berg case^S, while dynamic length scales are larger than 




FIG. 5: Spatial correlations between two replicas, a and b, at 
equal temperatures Ti = 0.14 ("Ti") and T 2 = 0.04 ("T 2 "), o r 
different temperatures ("MIXT"). The curve noted "y/TiT 2 " 
is the square root of the product of the data at Ti and T2 and 
coincides with the "MIXT" points, as expected in the absence 
of chaos. 



in the Ising modeli. Hence it appears potentially easier 
to detect chaotic temperature effects in Heisenberg sys- 
tems than in Ising systems^, so this possibility needs to 
be investigated. 

To do so we follow Ref. [^j and consider a two-site, 
two-replica correlation function, 



C 4 (r, t) = 



-y 

L 3 4^ 



;s?(t) 



where the two replicas a and b have the same interactions 
but age independently at different temperatures, T a and 
T b , with AT = T a - T b . If £ (AT) < £(T a ,i) then 
the overlap between the spin configurations in the two 
replicas becomes small in a simulation on timescale t. 

In Fig. [3 we show our results for the Heisenberg model 
with the same two temperatures Ti = 0.14 and T 2 = 0.04 
used in our previous cycles. Data is presented for the 
two-replica correlators in three different cases. 



"Ti". 



T b = Ti, and t» 



f" 



3728 = tu noted 



• T a = T" = T 2 , and 4° = = 57797 = t 2 , noted 
"T 2 ". 

• T a = Ti, T b = T 2 , C = 3728, and t b w = 57797, 
noted "MIXT". 

The simulation times have been chosen so that £(Ti , ti) — 
£,(T 2 ,t 2 ). This equality can be seen in Fig. [5] because the 
correlation functions "Ti" and "T2" are parallel in this 
log-lin representation at large r. By contrast these curves 
have a different slope at small r because short distance 
behavior is characterized by the temperature dependent 
exponent a(T) discussed above. 

Since the temperatures Ti and T 2 are very different, we 
need to take into account the overall increase of spin glass 
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order as the temperature is low ered"^. We therefore also 
plot v / C i (r : T 1 ,t 1 )C 4 (r,T2,t 2 ), which is called U y/T^ 
in Fig. El We find that "MIXT" and "V7\7^" are equal 
within our numerical precision, the result expected in the 
absence of chaos. We conclude that even weak chaotic ef- 
fects are not detectable in our numerical simulations de- 
spite large temperature jumps, AT/T C ~ 0.625, and large 
dynamic lengthscales, see the range for r in Fig. [S] The 
dynamic rejuvenation effects we observe can therefore be 
attributed entirely to the temperature dependence of the 
exponent a(T) describing the power law decay of spatial 
correlations at distances less than £(T,t). 

Of course temperature chaos could still exist at larger 
length scales. Although the timescales of experiments 
(relative to the microscopic time) are much longer than 
in simulations, the difference in length scales is not so 
pronounced, as we shall emphasize in Sec. Hence we 
feel it is unlikely that strong temperature chaos occurs 
in experiment either. Unfortunately, this is difficult to 
check since direct probes of length scales related to chaos 
effects are not experimentally feasible. As discussed in 
detail in Sec. IV Cl the experimental observation of full re- 
juvenation does not in itself prove that a strongly chaotic 
situation is reached in experiments. 



C. What is a direct quench in experiments? 

To our knowledge, full rejuvenation has never been 
found in numerical studies even in large temperature 
shifts, in contrast to experiments which do find full re- 
juvenation. One difference in procedures is that temper- 
ature changes in simulations are instantaneous, whereas 
they can only take place at a finite rate in experiments. 
We therefore need to study whether correlations built 
up during gradual cooling are relevant to the subsequent 
dynamics. If chaos were important in the simulations, 
the answer would presumably be no, since growth of cor- 
relations with time has to restart from scratch at each 
temperature. However, as we showed in Sec. IIII Bl no 
chaos effects are seen in our simulations. Hence we need 
to consider the effects of gradual changes in temperature, 
to see whether these modified protocols improve agree- 
ment with experiment. 

Firstly, rather than quenching from T = oo to Ti, we 
consider the effect of taking a finite initial temperature, 
T c < Ti < oo. This protocol allows us to investigate the 
effect of building spatial correlations at high tempera- 
tures on the aging dynamics at lower temperature. Our 
results for various Tj are presented in Fig. where we 
have adopted the following procedure. The temperature 
is quenched from T = oo to Ti where it is kept constant 
for 10 4 sweeps after which the temperature is instanta- 
neously quenched to the final temperature T\ — 0.04. 

For initial temperatures larger than Tj ~ 2.0 ~ 12.5T C 
the aging observed at T\ — 0.04 is similar to the one 
observed in a quench from Tj = oo. However, as soon 
as Ti < 2.0 aging is affected. In particular the total 




10° 10 1 10 2 10 3 10 4 



FIG. 6: Effect of a non infinite initial temperature in a 
quench. The system is first quenched from T = oo to various 
temperatures, Ti > T c ~ 0.16. Temperature is kept constant 
at T during 10 4 time steps after which it is quenched to the 
final temperature Ti = 0.04 at time t w = 0. 



amplitude of the relaxation, 

Ax(w)=x(w,t = 0)-x(w,t = oo), (21) 

is greatly reduced when Tj decreases. We then use 
Eq. I|21|) to compare the aging dynamics in various proto- 
cols. From Fig. [3 we find that the ratio of the amplitude 
of relaxation in a truly direct quench to the amplitude 
in a 0.14 — > 0.04 shift is about 5 while full rejuvenation 
would imply that this ratio is 1. If, however, one com- 
pares the 0.14 0.04 shift to a direct quench from a fi- 
nite temperature, say from Tj = 0.3 ~ 1.9T C , to T = 0.04, 
this ratio becomes ~ 2.8, i.e. closer to the full rejuvena- 
tion result. We conclude that spending some time at 
high temperatures makes the rejuvenation signal closer 
to what is observed experimentally, though we still do 
not see full rejuvenation. 

In real experiments, not only is the initial temperature 
finite, as above, but also the cooling from Tj to Tl is 
not instantaneous. Therefore not only does the system 
build correlations at high temperature Tj, but it also has 
some dynamics at all temperatures intermediate between 
T and Tl . This is likely to influence even more the aging 
dynamics at the final temperature. 

To investigate this point we have performed simula- 
tions of temperature cycles using finite cooling rates. We 
repeated the temperature cycles of Sec. fusing a realis- 
tic protocol. The system is first quenched from T = oo 
to T = 2.0 where it is kept constant during 10 4 sweeps. 
Then the temperature is decreased at a finite cooling rate, 
R, so that the time evolution of the temperature is of the 
form T(t) = Tj- Rt. The cooling is stopped at T\ = 0.14 
for a time t\, after which the temperature is decreased 
to T2 = 0.04 at the same cooling rate R. We simulated 
cycles with two different cooling rates, R\ = 0.002 and 
i?2 = 0.0005 = Ri/i (cooling rates are expressed in units 
of J/to where J = 1 is the variance of the distribution 
of coupling constants in Eq. and to = 1 is the Monte 
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10" 

u(t w ,i) 



FIG. 7: Subaging behavior found at T = 0.12 when the 
initial temperature is T = 0.3 and the cooling rate infinite. 
The horizontal axis is u(t„,t) = [(t + £ W ) 1_M - 4r M ]/(l - 
jit) which reduces to t/t v when fi = 1, and the vertical axis 
involves a factor g(t) to account for quasi-equilibrium short- 
time behavior, see Ref. [l| for details. The parameter /i is 
adjusted to get the best data collapse for different values of 
f w . The case n < 1, as found here, corresponds to subaging. 
The case, fM = 1, which we find when the initial temperature 
is T — oo, corresponds to simple aging. 
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FIG. 8: Time decay of the autocorrelation function C(ti + 
t2 + 720, ti + ti + 720 + r) in the third step of temperature 
cycles with perfect memory. The protocol is as in Fig. 
i.e. Ti = 0.14, T 2 = 0.04, ti = ti = 11159. The waiting time 
tw = ti + ti + 720 corresponds roughly to the end of the 
transient seen in Fig. Q The full line is the autocorrelation 
measured in a direct quench to Ti — 0.14 after waiting ti = 
11159, i.e. Cti (ti,ti + t). If memory is perfect, the data 
from the cycle agrees with that from the direct quench. Small 
deviations from perfect memory are visible at T2 = 0.08, but 
absent for lower T2 for which 'memory's perfect'. 



Carlo time unit). These values were chosen to give cool- 
ing times comparable to 1/ui, as in experiments**. We 
find that a finite cooling rate has two effects: 

1. All the amplitudes of relaxation are reduced. This 
is a somewhat natural observation. 

2. A less trivial result is that ratio of amplitudes be- 
tween a direct quench to Ti and a shift through T\ 
are again reduced from their R = 00 values. When 
1/u) = 1078, we find that these ratio are 5, 3.8, and 
3 for Fl — 00 , R\ and R2, respectively. 

These results again indicate that the finite cooling rates 
used in experiments, make the observed rejuvenation ef- 
fects closer to that in experiments, though we are still far 
from full rejuvenation. In fact, we shall argue in Sec. IV Cl 
that full rejuvenation is expected in experiments because 
of the much larger range of timescales that are probed 
there than in the simulations. 

We have shown that a non ideal quench very strongly 
affects aging behavior. In fact we find that all scal- 
ing behaviors reported in Ref. for simple aging ex- 
periments are affected. This is a likely explanation of 
the 'sub-aging' behavior systematically found in experi- 
ments^* while simulations indicate instead 'super-aging' 
behavio»i*S£. As a single example we show in Fig. 
the effect of a non-infinite initial temperature, T,; = 0.3, 
on the aging at temperature T = 0.12. The cooling 
rate is infinite. When Ti — 00 a simple scaling of 
correlation functions is observed at this temperature^, 
C(t w ,t + t w ) ~ g _1 (i)C(t/t w ), where g(t) accounts for 
the short-time quasi-equilibrium behavior. Instead, when 



Ti = 0.3, we find that a more complicated, sub-aging scal- 
ing form is needed, as shown in Fig. [7| We have system- 
atically found sub-aging behavior in non-ideal quenches. 
Given that experimental cooling times are always ex- 
tremely large when compared to microscopic timescales it 
is not surprising that this effect persists experimentally-ii, 
unless specific but empirically determined protocols are 
used*&. Cooling rate effects also imply that aging dy- 
namics probed (a) numerically, and (b) experimentally 
in 'direct quenches', are fundamentally different, which 
prevents a quantitative comparison of their scaling be- 
havior. 



IV. MEMORY 

Memory effects are simpler to understand than rejuve- 
nation effects. They directly result from the strong in- 
fluence of temperature on the timescales needed to equi- 
librate fluctuations on a given length scale. Dynamics 
at different temperatures but in similar time windows 
probe different length scales*^2i2a^Si*L*^. In this section 
we quantify these effects. 



A. Is there perfect memory for large shifts? 

In the inset of Fig. ^ we have shown that the aging in 
the third step of the temperature cycle appears to be, af- 
ter a short transient, the perfect continuation of the first 
step. However, this data is not completely convincing 
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because %(u;,i w ) decreases very slowly on the timescale 
of the simulation. It is better to study the full frequency 
dependence, or, equivalently, the time dependence of the 
spin autocorrelation function— 

In Fig. |H1 we show that the memory effect observed in 
Sec. [I] is indeed convincing, or, in an allusion to Billy 
Wilder, that 'memory's perfect—. The decay of the au- 
tocorrelation function in the third stage of the cycle for 
large Ti — T 2 is indeed the same, within our numerical 
accuracy, as the one obtained if the second stage of the 
experiment is dropped out. As in experiments, we con- 
clude that despite the strong rejuvenation effect observed 
in the second stage at temperature T2, the correlations 
built in the first stage at temperature Ti have been per- 
fectly preserved and can be retrieved when temperature 
is shifted back to its initial value. 



B. Is there memory for small shifts? 

In the previous subsection we showed that memory is 
essentially perfect for large temperature shifts. We now 
discuss what happens for smaller values of the temper- 
ature shift where we will see that cumulative aging be- 
comes a good approximation. To compare with the cu- 
mulative aging scenario we extract an effective age t e g 
by fitting the data for x(a>, t\ + t 2 + t) to Eq. lfTT|) . Ide- 
ally one can find a t c s value so that this data is equal 
to x Tl ( w i *i + ^eff + t) for all t. For technical reasons it 
is difficult to measure the effective age when times get 
large because the change in \ becomes too small. Hence 
we will extract t c s using a protocol with ti = 0, i.e. a 
sudden quench to T — T 2 followed by an upward shift to 
T = Ti at time t 2 ■ This modified protocol does not corre- 
spond to the cycle discussed in Sec. [I] but is used here as 
a convenient mean to measure effective aging times. Also 
we will actually do the fit to the time dependent correla- 
tion function in Eq. (jSJ)- This is, of course, equivalent to 
fitting data for \- 

Figure shows some data for this protocol as a func- 
tion of r = lj- 1 with Ti = 0.04, ti = t = 0, and 
t-2 = 11159. Just after the shift up to T\ we record the 
time decay of the spin autocorrelation functions. By def- 
inition, when T2 = T\ the autocorrelation function fol- 
lows the curve obtained in a direct quench to T\ = 0.04 
after t w = 11159. However, when T 2 < T\ the time 
decay of the autocorrelation function after the shift be- 
comes faster, but an effective age, t c ff < t w , can still be 
defined, since the solid lines in Fig. EI which are from di- 
rect quenches, go through the points, which are from the 
temperature shift protocol. In other words, matching the 
correlation functions as a function of r = uj~ 1 to the ex- 
pression analogous to Eq. with t\ = t = works well. 
We see from Fig. that t c g progressively decreases when 
T 2 decreases, as expected in the cumulative aging sce- 
nario of Sec.[H] Physically this means that aging at low 
temperature is less effective at building spatial correla- 
tions, or, in other words, that the growth of the dynamic 
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FIG. 9: Influence of the aging at low temperature Ta < 0.04 
on the subsequent aging at Ti = 0.04. The system is quenched 
directly from T — 00 to Tb (so ti = 0) , where it is kept during 
t2 — 11159 time steps, after which the temperature is shifted 
up to Ti = 0.04. Autocorrelation functions in these shifts are 
shown with symbols. They are compared to the ones, shown 
with full lines, measured in a direct quench to Ti = 0.04 and 
different waiting times i w = 2700, 4500, 7000 and 9500 (from 
left to right), chosen to match the temperature shift data. 
The matching is seen to work well. 



correlation length is slower at lower temperature. 

We have repeated this matching procedure for many 
different shifts, changing t 2 from 2154 to 2 x 10 5 time 
steps, the final temperature from T\ = 0.4 to Ti = 0.12, 
and the amplitudes of the shift, AT = T\ — T 2l from 
AT = 0.01 to AT = 0.05. The results are presented in 
Figs. 1101 and 1111 which also contain similar data for the 
Ising spin glass that are discussed below in Sec. II V 01 

We now compare our results for t e ff to the prediction 
of the cumulative aging scenario 



(22) 



which is just Eq. i|13fl with t± = t' = 0. For each of the 
parameters T± , T2 and t 2 corresponding to the points for 
the Heisenberg model in Fig. ^3 we determined £^ m us- 
ing Eq. and data for £(T,t) in Ref. 0. The ratios 



TABLE I: Evaluation of the cumulative aging hypothesis in 
small temperature shifts. 



T 2 


Ti 


*2 


tcff 
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r efl 


j / j cum 
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0.02 


0.04 


11159 


4500 


4200 
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0.04 


0.08 
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4200 


0.71 
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0.12 
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0.08 
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11159 
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0.04 


0.08 
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1.04 
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57797 
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11000 
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57797 
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11159 


22500 


22000 


1.02 



10 




0.1 0.2 0.3 0.4 0.5 0.6 0.7 
AT/Ti 



FIG. 10: The effective age t e g in a shift experiment for dif- 
ferent values of Ti at fixed £2- The system is quenched at 
T2 = T\ — AT where it ages during a time £2 = 11159 after 
which the temperature is shifted up to various temperatures 
T\. Open symbols are for the Heisenberg spin glass, filled 
symbols for the Ising spin glass. The solid line marked "ac- 
tivation" is the prediction from cumulative aging assuming 
barrier activation, Eq. 1231 . The line marked "modified acti- 
vation" is also for the cumulative aging scenario but assum- 
ing different form for f(T,t), namely £(T,t) ~ t 1/z{T) with 
z(T) = (Tb/T) ' 85 , which fits growth laws for the Ising spin 
glass. 



of t^g" 1 to t c g determined from fits like those in Fig. El 
are presented in Table |U We see that the ratio roughly 
takes values in the range [5, 2], with no obvious system- 
atic behavior. That the ratio is not perfectly 1 is hardly 
surprising given that one has to make use twice of imper- 
fect numerical data to estimate t^ m from Eq. (|22l) . We 
conclude, contrary to the preliminary investigations of 
Ref. that the cumulative aging hypothesis, Eq. (|2*2)l , 
is a good interpretation of the behavior of the Heisen- 
berg spin glass in temperature shifts of small amplitude. 
Quite importantly, these results validate the assumption 
of cumulative aging used in Refs. 5 8 37], where experi- 
mental data plotted as in our Figs.llOlandllllis one of the 
ingredients used to reconstruct growth laws for £(T,t). 

Alternatively, rather than estimate £ (T, t) from the nu- 
merical data of Ref. jj, one can assume an analytical 
form for the growth law, for example the barrier activa- 
tion model used to obtain Eqs. @, E3> and JTSJl. This 
predicts 

k ftr)=-f" lfe - (23) 

which is equivalent to Eq. 10 with the roles of T\ and 
T2 interchanged. It corresponds to the straight solid line 
marked "activation" in Figs. 1101 andllll We find that for 
all temperatures the measured i e ff he significantly above 
this result. Moreover, the dependence upon the final tem- 
perature T\ at fixed is weak. From the growth laws for 
£(T, t) reported in Ref. this result is reasonable, since 
the dynamic correlation length is very weakly dependent 




AT/Ti 

FIG. 11: Effective ages in shift experiments for different val- 
ues of t2 at fixed Ti . The system is quenched at Ti — AT where 
it ages during a time £2- The temperature is then shifted up 
to Ti. Open symbols are for the Heisenberg spin glass with 
Ti = 0.08 ~ 0.5T C , filled symbols for the Ising spin glass with 
Tl = 0.7T C but the same times £2 as the Heisenberg model. 
The straight line is the prediction of cumulative aging with 
thermal activation, Eq. I23H . 



on temperature for times smaller than t ~ 10 3 and only 
after that does it enter a regime dominated by thermal 
activation 1 . We therefore expect that shifts performed 
at larger times £2 will get closer to the cumulative aging 
scenario with a barrier activation form for £(T, t). 

We confirm this expectation in Fig. II II where we work 
with a constant final temperature, Ti = 0.08 ~ 0.5T C , 
but change the duration of the initial period over two or- 
ders of magnitude. To compare data with different shift- 
ing times, we plot ln(i ff/£2)/hi£2 vs. AT/Ti for which 
cumulative aging with thermal activation, Eq. I|23|) , pre- 
dicts a linear relation of slope —1, independent of t2- 
Upon increasing we find that the data get closer to 
this prediction, but still lie systematically above it. Sim- 
ilar results are found for T\ = 0.12 ~ 0.75T C . As a rough 
estimate, if the evolution of these curves persists at much 
larger times it would require about 4 more orders of mag- 
nitude, i.e. i^Ao ~ 10 9 , to get curves that eventually lie 
on or below the thermally activated estimate. This is 
not inconsistent with the experimental finding that these 
curves lie below the Arrhenius line in Heisenberg spin 
glass samples^Siia since experiments are performed on 
timescales that are typically 10 12 -10 16 times larger than 
microscopic flipping times, see e.g. Fig. 1121 

In this section we performed upward temperature shifts 
of relatively small amplitude. We expect that cumulative 
aging would also work for small temperature changes in 
a downward shift, but for technical reasons it is difficult 
to test extensively this hypothesis directly, because effec- 
tive ages very quickly become too large to be numerically 
measurable in downward shifts. We nevertheless add in 
Table H] the result for a downward 0.14 — > 0.12 shift from 
the data displayed in Fig. ^Jl For this particular exam- 
ple, cumulative aging works indeed very correctly. 
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C. Does spin anisotropy play a role? 

In this subsection we compare our results for the tem- 
perature shifts with similar results obtained in the three- 
dimensional Ising spin glass, using exactly the same ther- 
mal protocols and the same procedure to extract effective 
ages. To this end we needed to extend significantly the 
numerical results obtained by one of us and Bouchaud 
in Ref. j2£j to which we refer for technical details con- 
cerning the Ising simulations. These new results for 
the three dimensional Ising Edwards- Anderson spin glass 
are reported along the ones for the Heisenberg model in 
Figs. ITU1 and ITT1 

A quantitative comparison between the two sets of 
data can be performed if one assumes that in both cases, 
Monte Carlo time units represent the microscopic flip- 
ping time which we fix to to = 1 in both simulations — a 
physically reasonable assumption. From the comparison 
between the two models one can draw two main conclu- 
sions. 

• Curves for the Ising spin glass lie below the ones 
of the Heisenberg model for all the shifts we have 
performed, so t e fi/t2 is smaller for the Ising case. 
In other words, the effect of a temperature shift 
on aging dynamics is stronger for the Ising simula- 
tions. However, the opposite behavior is observed 
in experiments which compare strongly anisotropic 
(Ising) samples with isotropic (Heisenberg) sam- 
ples 8 . 

• Changing the duration of the shift over two orders 
of magnitude has a strong effect on the Heisenberg 
spin glass, as described in Sec. lIVBl above. but very 
little or no effect in the Ising case, see Fig. ^2 To 
our knowledge there are no systematic experimen- 
tal investigations concerning this point but if this 
trend persists to much larger timescales, it could 
lead to a situation where Heisenberg data lies below 
the "activation" curve while Ising data lies above 
it, as is found experimentally^. 

The Ising data agrees better with the barrier activa- 
tion form for £ (T, t) in the cumulative aging picture than 
does the Heisenberg data. Although we use the termi- 
nology "barrier activation" the same result, Eq. (|23ll . ap- 
plies if the barrier height only depends logarithmically 
on length scale, in which caso 27 i 28 i 32 £(T,t) ~ t 1 ^ with 
z = Tq/T, i.e. £ grows with a power of t. Recently, 
algebraic laws with z = [Tq/T) 1 with 7 ~ 0.85 were re- 
ported^. As shown in Fig. ^| the introduction of the 
adjustable parameter 7 allows one to understand devi- 
ations from simple thermal activation in the Ising spin 
glass within the cumulative aging hypothesis. Possibly 
critical fluctuations near T c renormalize the microscopic 
flipping tim o 5 i 6 i 29 in such a way that the growth is ap- 
proximately of this form in numerical time windows. It 
would be interesting to check if experimental data taken 



in anisotropic (Ising) samples can be fitted with the same 
"modified activation" growth law. 



V. DISCUSSION 

A. Memory effects 

Memory effects stem from thermally activated dynam- 
ics which implies that temperature so strongly influences 
the growth of the dynamic correlation length, £(T, t), 
that aging is much less effective at building spatial cor- 
relations at lower temperatures. Therefore lengthscales 
that are quasi-equilibrated at some temperature Ti can 
effectively be frozen if the temperature is decreased to 
T 2 < Ti . Spatial patterns imprinted in the systems at Ti 
are then naturally retrieved when temperature is shifted 
back to its original value. From this perspective it is nat- 
ural that memory effects are found in so many different 
disordered materials where activated dynamics is ubiqui- 

^ Ou3 l 4 2 i 3 i 4 i 5 i 6 i 7 i 8 i 9 i 10 4 n i 12 4 13 i 14^ 

In Fig. El we show an example of growth laws as ex- 
tracted from experimental data in Heisenberg samples 
in Ref. [37| • The precise details of the fits which gave 
these curves will not be relevant here because our main 
conclusions will be qualitative. We use this graph to dis- 
cuss a temperature cycle occurring between temperatures 
Ti = 0.825T C and T 2 = 0.7T C . WitbS T c = 16.7 K, this 
gives Ti = 13.77 K and T 2 = 11.69 K, so that AT ~ 2K, 
as in the original experiment of Ref. . 

For concreteness we assume a microscopic time of 
to = lCP 12 s and take t\ = £2 = 10 4 s so, in units of 



the microscopic time, we have t\ = £2 = 10 16 . The 
correlation lengths £1 and £2 reached at Ti and T 2 in 
a time t\ = t% are 25.3 and 13.3 respectively, indicated 
by dashed horizontal lines. To reach a length scale of £1 
at the lower temperature T2 would require an astronom- 
ically large time of order t' ~ 10 41 to = 10 29 s, given by 
Eq. (|14|) . which is indicated in the right hand box of the 
figure. Also relevant is an estimate of the transient time, 
t tr , required to reequilibrate fluctuations at scale £2 when 
the temperature is increased back to Ti . This is given im- 
plicitly by £(Ti, f tr ) =& = £(T 2> t 2 ). From Fig. d we 
see that ttr is of order 1 msec, hardly detectable if the fre- 
quency is of the order of a few Hz. In general, we expect 
perfect memory if Eq. I|17|) and the condition 

ttr "C ti (needed for perfect memory), (24) 

are both satisfied. Within the barrier activation model 
and for t\ ~ £2, Eqs. (|24() and (|17f) are actually equivalent 
since this model predicts that 



hit, 



hit' 



In ttr lnti 



Ti 
T 2 ' 



(25) 



Equation (|18[) , which corresponds to Eq. i|17fl for the bar- 
rier activation model, is satisfied for the experimental sit- 
uation in Fig. 1121 so memory should be perfect, as was 
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FIG. 12: Solid curves show f (T, £) (with £ in units of the 
microscopic time t = 10~ 12 s) inferred in Ref. for a 
Heisenberg spin glass at temperatures T\/T c — 0.825, and 
TijTc — 0.7. Note the break in the horizontal scale between 
the two boxes. We assume waiting times at Ti and T2 of 
£1 = £2 = 10 4 s = 10 16 £o. The length scales equilibrated at 
Ti and T 2 are £1 = £(Ti,£i) and £2 s f(T a ,t 2 ) (indicated 
by horizontal long-dashed lines). To reach length scale £1 
at the lower temperature T2 one would have to wait a time 
£' ~ 10 41 1 ~ 3 x 10 21 years, given by Eq. JT]J- This is truly 
astronomical, so fluctuations between £2 and £1 are effectively 
frozen during the time £2 spent at T2, which is the origin of 
the memory effect. When the temperature is raised back to 
Ti , see Fig. fluctuations on length scale £2 have to reequili- 
brate at Ti, which takes a "transient" time £tr — 10 9 = 10 -3 s 
(which is very short; another requirement for perfect mem- 
ory). We also show £ CO ol, the time spent 'close to' a given 
temperature during cooling, and indicate, by a dotted line, 
the growth at T — T coo i = 0.795T C , the temperature at which 
£(T C ooi, tcooi) is equal to £ 2 - We also define £ coo i = £(Ti, £ CO oi)- 
In cooling to T = T2 the system will have correctly equi- 
librated for temperature T 2 up to scale £ m i n = £(T2,£ CO oi). 
During subsequent aging for time £2 at T = T2, fluctuations 
on scales between £ m j n and £ C ooi (shown by the thick line 
with arrows) have to reequilibrate, which gives rise to rejuve- 
nation. The time scale probed in our simulations is of order 
£ s i m ~ 10 5 , which is much smaller than in experiments. How- 
ever, the difference between the length scales probed in ex- 
periment and simulations is much smaller than the difference 
in timescales. 



indeed found 9 -. However, Eq. I|18|) is harder to satisfy 
in numerical simulations since the timescales are shorter. 
Hence larger temperature steps have to be chosen in sim- 
ulations, but, nonetheless, Eq. I|18|) can then be satisfied. 
This conclusion holds for both Heisenberg and Ising spin 
glass modelo 26 ! 28 ! 29 ! 31 ! 32 ! 33 . 



While the details of the numbers in this discussion 
can be debated, it is surely true in general that chang- 
ing the temperature in experiments gives a large change 
in timescales (though not a very large change in length 
scales) , and that perfect memory can be obtained in this 
situation with moderate to large temperature shifts. 



B. Physical origin of rejuvenation effects 

We have seen in Sec. IV Al that to get memory it is 
sufficient to have a wide separation of time scales. We 
now turn to rejuvenation effects which are more difficult 
to understand since, by itself, Fig. ^] does not explain 
why aging is strongly restarted when the temperature is 
shifted from Ti to T2. The important question is that, 
since excitations on lengthscales active at T2 were fully 
equilibrated at T\ just before the shift, why do they need 
to reequilibrate at all upon a small temperature change? 

In this paper we have been able to answer this ques- 
tion for the Heisenberg spin glass model simulated on 
timescales up to 10 5 . We find that spatial correlations at 
equilibrium (i.e. at distances less that £(T, £)) are close to 
algebraic with a temperature dependent exponent a(T) 
so that excitations on all lengthscales up to £ have to 
readapt at each temperature. This interpretation is very 
close to the physical interpretation of the behavior of the 
two-dimensional XY model when temperature is shifted 
along its critical line^ 9 .. 

As discussed in Section IIII Bl we found no trace of 
chaotic behavior of spatial correlations with temperature, 
though it is possible that chaotic effects could set in at 
larger lengthscales. However, in the hypothetical tem- 
perature cycle of Fig. 1121 which corresponds to experi- 
mental parameters, we see that the difference in length- 
scales probed by simulations and experiments is not very 
drastic (a factor of about 3 or 4) so we are tempted to 
conclude that chaos also does not occur in experiments. 
Even if it did, chaotic effects would appear in addition 
to the signal characterized in this paper, so experimen- 
tal results would present a mixed character, difficult to 
analyze quantitatively within one scenario or the other. 

The situation found here is qualitatively very similar to 
what is observed numerically in Ising spin glasses in var- 
ious dimensions^SiSSiSi^SiSi. Differences between mod- 
els arise only at a quantitative level. For instance, in 
the three dimensional Ising spin glass, the exponent a 
only depends weakly on temperature taking the value of 
about 0.5 throughout the spin glass phased. Correla- 
tions change more significantly in four dimensions 2 ^ with 
a changing from 0.9 and 1.6 between 0.5T C and T c . As a 
result, rejuvenation effects are relatively pronounced in 
four dimensions, while almost absent in thre e - 28 ! 31 . By 
comparison, a in the three dimensional Heisenberg spin 
glass has an intermediate behavioni since it changes from 
0.8 to 1.1 between 0.5T C and T c . However this relatively 
small variation is compensated by the fact that dynamic 
lengthscales for the Heisenberg model are also larger than 
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for the Ising case. 

C. Experimental observation of full rejuvenation 

We have seen in Sec. IV Bl that the observation of par- 
tial rejuvenation in the simulations for large temperature 
shifts can be well understood. Here, we give a plausible 
explanation of the full rejuvenation observed experimen- 
tally, an important ingredient being a very large separa- 
tion of time scales, much larger than is feasible in simu- 
lations. 

As mentioned in Section lill CI 'direct' quenches in ex- 
periment are not instantaneous, and incorporating this 
into the simulations gave results which were somewhat 
closer to full rejuvenation. Here we develop a phe- 
nomenological description of aging which includes a finite 
cooling rate. An important concept in it is the time spent 
'close to' a given temperature^, where a precise defini- 
tion of 'closeness' will not be needed to illustrate the main 
points qualitatively, but presumably requires that spa- 
tial correlations (on the cooling timescale) do not change 
'much' while the temperature is 'close' to a given value. 
Let us denote this timescale by t CO oi- As an example, if we 
assume that a quench takes place in 1 s, and divide this 
time into 100 intervals, we have t cooi = 0.01s = 10 10 t , 
as indicated in Fig. ^] This is certainly rough, but we 
can vary t coo i quite substantially without invalidating our 
main conclusions. 

It will be convenient, for the subsequent discussion, 
to define various length and time scales which arise in 
quenching down to T — T2 at a given rate. Correlations 
on length scale r will freeze, i.e. drop out of equilibrium, 
at temperature Tf(r) where 

Z(T i (r),t cool )=r. (26) 

To determine the extent of rejuvenation in a T-shift to 
T2, we need to consider the correlations on length scales 
up to £2- The temperature where correlations on this 
scale fall out of equilibrium is 

Tcooi = T f (£2) , (27) 

which is Tcooi — 0.795T C in the example shown in Fig. 1121 
During the cooling process, when the temperature has 
reached T = T\ the correlation length will be 

£cool = £(Ti, tcooi) (28) 

see Fig. When the system has been cooled down to 
T = T2, the system will be equilibrated for this temper- 
ature up to scale 

U =£(T 2> tcooi), (29) 

which is also shown in Fig. ^] 

We are now in a position to compare aging after a 
'direct quench' to T2 with that following a tempera- 
ture shift from T\ to T2. Suppose first that T\ > T coo i 



(i.e. £ CO oi > £2), which is the situation in Fig.^J Then 
the time spent waiting at T± will have no effect on the 
behavior at T2 because this will only change correlations 
at scales larger than £2 that are anyway frozen at T2. 
The important correlations are those of scales between 
£ m i n and £2 and these only freeze out during the sub- 
sequent cooling from T coo i to T 2 , see Fig. ^2] Provided 
correlations on length scales between £ m j n and £2 depend 
on temperature (through the temperature dependence of 
the exponent a(T)), these will have to reequilibrate while 
waiting at T2, and so there will be a rejuvenation sig- 
nal. Furthermore, the signal will be same for the direct 
quench and the temperature shift from T\, i.e. we have 
full rejuvenation. 

On the other hand, if T\ < T coo i (so £ C ooi < £2) waiting 
at T\ does enhance correlations at scales < £2 (to be 
precise, at scales between £ C ooi and £2) relative to a direct 
quench. Hence rejuvenation will only be partial in this 
case. 

Hence we can succintly express the condition for full 
rejuvenation as 

£cooi > £2 (full rejuvenation), (30) 

or in other words, 

the correlation length developed at T = T\ 
during cooling is greater than the correlation 
length subsequently developed during waiting 
at the lower temperature T = T-i- 

To get a rough idea of the numbers implicit in Eq. i|3TJ|l , 
we take the simple barrier activation model for £ (T, t) 
discussed in Sec. [H] in which £(T, t) is assumed to be a 
function of Tint. The condition for full rejuvenation, 
Eq. 130|) . then becomes 

7W2 > MWtcool) (M1 rejuvenation) . (31) 

T 2 In t coo i 

The deviations from simple barrier activation used in the 
plots in Fig. 1 121 actually allow full rejuvenation when T\ 
is somewhat closer to T2 than given by Eq. (51) ■ Since 
we need t2 S> t CO oi (otherwise the signal is dominated by 
initial transients), Eq. i|31|) implies that t2 must be huge. 

Given our numerical results^ for £ (T, t) , we estimate 
that tcooi > 10 3 is at least necessary to satisfy Eq. (jSUJl, 
implying that the total cooling time is about 10 5 , so 
that aging times should be t\ ~ ti ^S> 10 5 which is not 
presently feasible in simulations. This justifies our inabil- 
ity to reach the full rejuvenation limit in this numerical 
work, as opposed to experimental investigations. By con- 
trast, perfect memory effects can be obtained in simula- 
tions because they do not rely on the existence of finite 
cooling rates; compare Eqs. (|T%|) and i|3*T|) . 

We also suspect that Eq. (5J) is necessary to observe 
the spectacular 'dip' in ac susceptibility measurements^. 
The reason a sharp dip has not been seen in simulations 31 
is, in our view, because the timescales did not satisfy 
Eq. H31fl . In an effort to get closer to Eq. (|31|l . we have 
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FIG. 13: Effect of a stop during cooling on the zero-field 
cooled magnetization. The duration of the stop is t s t op = 5 x 
10 4 , and two temperatures T stop = 0.14 (squares) and T st op = 
0.08 (circles) are used, as shown by vertical arrows. We plot 
the difference between M s to P and M z f c , the zero-field cooled 
magnetizations with and without the stop, respectively. The 
cooling and heating rates are R = 5 x 10 -6 , the magnetic field 
is h — 0.01. A dip centered around T s t op is observed, but this 
is broader than in experiments. 



reproduced the experimental protocol of Ref. 15] where 
a dip experiment is realized using the magnetization as 
a physical observable. The system is gradually cooled at 
rate R = 5 x 10~ 6 from high temperature, Tj = 0.35, 
to very low temperature T — 0.02. It is then immedi- 
ately reheated at the same rate R with a small magnetic 
field, h = 0.01, which ensures linear response^. The zero 
field cooled magnetization, M z f c (T), is then recorded. We 
then repeat the same protocol but this time include a 
stop of duration t stop at temperature T st0 p during cool- 
ing. Upon reheating we now measure M st0 p(T). The 
difference M stop — M z f c for t stop — 5 x 10 4 and two differ- 
ent temperatures, T s top = 0.14 and T st0 p = 0.08 is pre- 
sented in Fig. EH Curves have the typical shape found 
in experiments^ where the difference is maximal close to 
T st0 p and becomes at smaller and larger temperatures. 
However the dip found here is broader than in experi- 
ments. The fact that the curve has a bump at T st0 p is 
akin to a memory effect since upon reheating the system 
remembers it has aged there. The fact that the difference 
diminishes at T < T st0 p is a rejuvenation effect, because 
despite having aged close to T st0 p the magnetization gets 
close to the reference curve. A full rejuvenation would 
imply that the difference really goes to 0. As above, we 
do find a good amount of memory but only a partial reju- 
venation, because the separation of timescales is smaller 
than in experiments. 

Recently, experiments have been carried out on su- 
perspin glasses^, in which the microscopic timescale 
to is considerably larger than in standard spin glasses 
(to ~ 10 _5 s), and so the timescales probed are closer to 
those of our simulations than in experiments on standard 
spin glasses. Interestingly, results of these experiments 
are quite similar to those of our simulations and, in par- 



ticular, rejuvenation is only partial even when tempera- 
ture steps are quite substantial. In our view, the claim 
made in Ref. [Tj] that rejuvenation is "absent" is merely 
a matter of definition, and we prefer to say that rejuve- 
nation exists but is not full. Lack of full rejuvenation 
observed in superspin glasses is consistent with our dis- 
cussion if the spread of timescales is not large enough for 
Eq. JSDJl or to be satisfied. Implicit in Ref. is 
the idea that full rejuvenation necessarily implies strong 
temperature chaos. However, we have argued here that 
full rejuvenation does not require temperature chaos; just 
a large separation of time scales and a temperature shift 
which is not too small. 



VI. SUMMARY 

We have numerically studied memory and rejuvena- 
tion effects in the three dimensional Heisenberg Edwards- 
Anderson spin glass. The main difference between ex- 
periments and simulations is that the simulations have 
a much less pronounced separation of timescales. As a 
result, memory effects in temperature cycles can only be 
observed numerically for larger temperature shifts than 
in experiments. 

Similarly, we find that the timescale gap between ex- 
periments and simulations also produces a qualitative dif- 
ference when Ising and Heisenberg models are compared. 
In our numerical time window, the effect of a temperature 
shift on aging dynamics is stronger for Ising systems than 
for Heisenberg systems, see Fig. 1101 and Sec. IIV CI since 
the dynamic correlation length varies more strongly with 
T in the Ising case. However, in experiments, the effect 
is the opposit e) 8 ! 14 . The numerical data shift, but only 
slowly, towards experimental observations when larger 
timescales are simulated, see Fig. ^2 

In addition to memory effects, we also observe partial 
rejuvenation for large temperature shifts. However, we 
find no sign of temperature chaos even for much larger 
temperature shifts than in experiment. The main differ- 
ence between the results of simulations, including ours, 
and experiments is that simulations never find full reju- 
venation. We have given an explanation of this which 
does not involve temperature chaos but rather depends 
on (i) the finite cooling rate in experiments and (ii) the 
much larger separation of time scales in experiments than 
in simulations. The finite cooling rate also appears to be 
the explanation for the 'sub-aging' behavior found in ex- 
periments. 
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